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Abstract. The atmospheric neutrino data collected by IceCube experiment and its low- 
energy extension DeepCore provide a unique opportunity to probe the neutrino sector of 
Standard Model. In low energy range the experiment have observed neutrino oscillations, 
and the high energy data are especially sensitive to signatures of new physics in the neutrino 
sector. In this context, we previously demonstrated the unmatched potential of the experi- 
ment to reveal the existence of light sterile neutrinos. The studies are routinely performed in 
the simplest 3 + 1 model concentrating on disappearance of muon neutrinos of TeV energy 
as a result of their mixing with a sterile neutrino. We here extend this analysis to include 
cascade events that are secondary electromagnetic and hadronic showers produced by neutri- 
nos of all flavors. We find that it is possible to probe the complete parameter space of 3 + 1 
model, including the poorly constrained mixing of the sterile neutrino to tau neutrinos. We 
show that u T — v s mixing results into a unique signature in the data that will allow IceCube 
to obtain constraints well below the current upper limits. 
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1 Introduction 

Oscillation of neutrino flavor has been confirmed by a variety of data from atmospheric, 
solar, reactor and accelerator neutrino experiments [1]. A consistent description of the oscil- 
lation mechanism, that accommodates all the data successfully, can be achieved by assuming 
three neutrino mass eigenstates (with at least two nonzero masses) and the mixing between 
them. In this 3v framework all the neutrino states have the standard weak interaction and 
the oscillation of neutrino flavor results from the differences between mass and weak inter- 
action eigenstates. Although the majority of experimental data is consistent with the 3z^ 
framework, there are anomalies that challenge this framework. These anomalies include: the 
long-standing evidence for za, — > v e oscillation in the LSND experiment [2], the recent excess 
observed in both the —> v e and i>a — > v e channels in the MiniBooNE experiment [3, 4] 
which supports the LSND result, the v e disappearance in short baseline reactor experiments 
associated with the recent re-evaluation of reactor neutrino flux showing a 3% increase [5, 6], 
and the v e disappearance observed in the GALLEX [7] and SAGE [8] experiments (Gallium 
anomaly). In addition to these anomalies in neutrino oscillation experiments, cosmologi- 
cal data favor the existence of extra light degrees of freedom in the universe [9-13]. For a 
thorough review of all these anomalies see [14]. 

A minimal framework that can accommodate the anomalies mentioned above is the 
3 + 1 model, which adds an almost sterile state to the 3is framework, with the mass of the 
new state ~ 0(1) eV. The sterile state can mix with the three mostly active neutrino states, 
inducing flavor oscillation between the sterile flavor state v s and the three active flavors v e , 
Vp, and v T . Within this scheme, the reactor and Gallium anomalies can be explained as v e — v s 
mixing, while the LSND and MiniBooNE anomalies are the result of both v e — v s and Vn — v s 
mixing. Considering the complete parameter space of the 3 + 1 model, v s can also mix with 
i/ T , a component of the scheme that is out of reach of the experiments mentioned above and 
poorly constrained by a variety of proposed experiments. 

In this paper we show how to probe v T — v s mixing using cascade events in IceCube. 
The effect of sterile neutrinos on the atmospheric neutrino flux and the possibility of its 
detection have been previously considered in [15-21]. In the presence of sterile neutrinos 
matter effects on neutrinos propagating through the Earth enhance active-sterile neutrino 
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oscillations. This leads to observable distortions in energy and zenith distributions of the 
atmospheric neutrino flux. In this regard, neutrino telescopes such as IceCube are perfect 
detectors in the search for sterile neutrinos. In studies performed so far only events producing 
muon tracks in IceCube, that are sensitive to Vn — v s mixing, have been considered. In this 
paper we consider cascade events and we show that it is possible to probe mixing of v s with 
all active flavors, including the v T — v s component whose measurement is challenging. 

The paper is organized as follows: in section 2 we review the 3 + 1 model presenting 
the formalism describing vacuum oscillation probabilities in section 2.1 and matter effects in 
section 2.2. In section 3.1 we calculate the cascade event rates from atmospheric neutrinos in 
the DeepCore part of IceCube and define the x 2 function used in our analysis. In section 3.2 
we derive the sensitivity of DeepCore to v e — v s and — v s mixings, and in section 3.3, 
which contains the main result of this paper, we present the sensitivity of DeepCore to 
v T — v s mixing. Finally, we conclude in section 4. 



2 Framework of 3 + 1 model 

The 3 + 1 model consist of the three standard active neutrino states (u\, 1/2, ^3) and a mostly 
sterile state with mass TO4 ~ 1 eV. In this model, in addition to the standard mixing 
parameters (#12, #13, #23, Amf^ — Am 2 ^ and Am 2 ,^, f° ur new mixing parameters are in- 
troduced: three mixing angles On (where i = 1,2,3), and one new mass-squared difference 
Am^j = m 2 — m\ ~ Am| 2 — Am| 3 , assuming that CP is conserved in the neutrino sector. 
The master evolution equation of neutrinos in the 3 + 1 scheme can be written as: 



i — 
dr 



-^U 4 M 2 U 4 t + V(r) 



"p , (2-1) 

a/3 



where M 2 is the 4x4 mass-squared differences matrix given by 

M 2 = diag (0, Am^Ara^Am^j) , (2.2) 

and V(r) is the diagonal matrix of matter potential as a function of distance r, given by 

V(r) = V2G F dmg(N e (r),0,0,N n (r)/2) . (2.3) 

Here Gf is the Fermi constant; N e (r) and N n (r) are the electron and neutron number density 
profile of the medium neutrinos propagate in it. The 4x4 unitary mixing matrix U4 can be 
parametrized as 1 [22]: 

U 4 = R 34 (9u)K 24 (e 24 )K 14 (e u )K 23 (e 23 )K 13 (e 13 )K 12 (9 12 ) , (2.4) 

where R 1J (#jj) = 1, . . . , 4 and i < j) is the 4x4 rotation matrix in the zj'-plane with the 
angle with elements 



RU(%) 



= (8ikSit+5jkSji)cij+(6ik6ji-5u5jk)sij+[(l - (5jk)(l - 6ji) + (1 - 5u)(l - 5jk)} 5u , 

M 

(2.5) 

where Cy = cos 8ij and Sij = sin 9ij . 

1 Since the rotation matrices R 14 and R 23 commute, the parametrization in eq. (2.4) is equivalent to the 
parametrization U 4 = R 34 R 24 R 23 R 14 R 13 R 12 . 



- 2 - 



Various experimental data can be used to constrain the oscillation parameters in 3 + 1 
model: #14, #24, #34 and Am^. In this section we discuss the oscillation probabilities, ob- 
tained from the evolution equation in eq. (2.1), and the oscillation parameters that can be 
constrained in each experiment. In section 2.1 we briefly summarize the oscillation probabil- 
ities in vacuum and the current constrains/indications on mixing parameters. In section 2.2 
we study the oscillation probabilities in matter, which is relevant for this paper, for the 
atmospheric neutrinos propagating inside the Earth. 

2.1 Oscillation probabilities in vacuum 

For reactor and short baseline accelerator neutrino experiments searching for the active-sterile 
oscillation, the oscillation probability can be calculated from eq. (2.1) by omitting the V(r) 
term and the oscillation can be effectively approximated by a two flavors approximation. The 
reactor neutrino experiments searching for v e disappearance, actually measure the survival 
probability 

P(u e ->• u e ) ^ 1 - sin 2 2^ ee sin 2 ( , (2.6) 

where 

sin 2 2tf ee = 4|U e4 | 2 (l-|U e4 | 2 ) • ( 2 - 7 ) 

From the parametrization of eq. (2.4) U e 4 = sin #14 and t? ee = #14. Recent re-evaluations 
of the reactor u e flux show a ~ 3% increase in the flux [5, 6] hinting at a deviation of 
P{pe. — > v e ) from one. The global analysis of all the reactor neutrino experiments leads to 
best-fit values [23]: (Am^, sin 2 2$ ee ) = (1.9 eV 2 , 0.13) with a 2.8a significance. The inclusion 
of the Gallium anomaly, solar and u e C data leads to larger values for Am^ with a significance 
~ 3<r; see [23]. Tritium beta decay experiments provide an independent way of constraining 
i? ee because a sterile neutrino will distort the electron spectrum [24-30] . Although the current 
data from the Mainz experiment are barely sensitive to the parameter space favored by the 
reactor anomaly [29], the forthcoming KATRIN experiment is expected to cover the complete 
allowed region in (Amfj, sin 2 2d ee ) space [30]. 

The LSND [2] and MiniBooNE [3] experiments search for excess in the Vaipn) — > v e {p^) 
oscillation channels, using baselines of Llsnd = 30 m and -^MiniBooNE = 540 m. With these 
baselines we have Am§ 1 L LS ND,MiniBooNE/(4.E , ! ,) < 1 and Am^LLSND.MiniBooNE/^^ < 1, 
and thus the probability of v^ip^) — > v e {T> e ) oscillation can be written as: 

P(M"») -» M"e)) = sm 2 2# eM sin 2 i ^™^ ^} , (2-8) 

where 

sin 2 2tf eM = 4|U e4 | 2 |lV| 2 . (2.9) 

In our parametrization U M 4 = cos 9u sin 024 > therefore LSND and MiniBooNE are sensitive 
to both #14 and #24- The recent MiniBooNE fit of neutrino and anti- neutrino data gives the 
best-fit values (Am^, sin 2 2$ e/Lt ) = (0.037 eV 2 ,1.0) with 3.8a significance [3, 4]. However, 
the large best-fit value of sin 2 2-# eAt mainly comes from the anti-neutrino data such that the 
best-fit values from the analysis of neutrino data is (Am^sin 2 2i} efl ) = (3.14 eV 2 , 0.002). 

The MINOS experiment, with near and far detectors at baselines 1.04 km and 735 km 
from the source, measures the v„ —> Vn oscillation probability by comparing the rate of events 
induced by charged current (CC) interactions at near and far detectors. Although the deficit 
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of CC events at the far detector is consistent with —> v T oscillations, in the 3 + 1 model, 
this deficit is sensitive to active-sterile mixing. Assuming the range of Ara^ to be such that 
the active-sterile oscillation do not take place at the near detector and average out at the far 
detector (i. e.; 0.2 < Am| 1 (eV 2 ) < 1), the survival probability can be written as [31]: 

P(u, -+u ll ) = l- 4 {|U, 3 | 2 (1 - |U, 3 | 2 - |IV| 2 ) sin 2 + - |IV| 2 )} . 

(2.10) 

Analogous to eq. (2.7), we can define 

sin 2 2^EE4|U M4 | 2 (l-|U / , 4 | 2 ) , (2.11) 

and the measurement of probability in eq. (2.10) by MINOS is sensitive to i? w (or #24, 
if we assume 0x4 = in the fit of MINOS data). In the analysis of reference [32], the 
MINOS collaboration reported the upper limit U M 4 < 0.019 at 90% C.L., which corresponds 
to sin 2 < 0.075. Also, in [33] the MINOS is re-analyzed for a wider range of Am^, 
yielding the same upper limit for Am^ < 1 eV 2 (sin 2 2i9 w < 0.09) and a weaker limit for 
Am 2 41 > 1 eV 2 . The best-fit point of [33] is (Am| l5 sin 2 2i? w ) = (6.76 eV 2 ,0.48). 

All matrix elements appearing in the oscillation probabilities in eqs. (2.6), (2.8) and 
(2.10) can be written in terms of the mixing angles #14 and #24- Thus, the three effective 
mixing angles (i9 ee , f^e/xi ^mm) are n0 ^ independent and satisfy the following relation: 

sin 2 2tf e/ , = 4 sin 2 tf ee sin 2 0^ , (2.12) 

which makes sin 2 2$ eAt double suppressed and leads to some tension between the results of 
the above mentioned experiments (see [33-35]). 

The only available experimental data sensitive to the angle #34 is from MINOS. By 
comparing the rate of events induced by neutral current interaction at near and far detectors 
of MINOS, it is possible to measure the Vp —> v s oscillation probability. In 3 + 1 scenario, with 
the assumption of no oscillation at near detector and averaged oscillation at far detector, we 
have (assuming CP conservation) [31]: 




(2-13) 

As can be seen, the i/„ — > u s oscillation probability depends on the U S 3 and U S 4 matrix 
elements, which in the parametrization of eq. (2.4), are given by: 

U S 3 = — cos #24 cos #34 sin #13 sin #14 — cos #13 cos #34 sin #23 sin #24 — cos 613 cos #23 sin #34 

and 

U S 4 = COS #14 COS #24 COS #34 . 

The dependence of these matrix elements on #34 leads to the unique opportunity to constrain 
this angle using MINOS data. From the measurement of muon disappearance probability 
MINOS collaboration obtained the upper limit of sin 2 2# 34 < 0.59 at 90% C.L. [31, 32]. 

To probe the mixing angle #34 by vacuum oscillation, i.e. when matter effects are 
subdominant, oscillation probabilities containing one of the matrix elements from the third 
or fourth rows of U4 should be measured. This implies that in order to constrain #34 one 
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has to measure the oscillation probabilities v a — > v T or v a — > v s , where a = e,/j,,r. Among 
these the — > v s oscillation has been probed by MINOS (see eq. (2.13)) as discussed above, 
and the — > v T channel can be explored by the OPERA experiment [36, 37]. Also, the 
sensitivity of proposed neutrino factories to #34 through v e — > v T and — > v T channels has 
been studied in [38-40]. 

2.2 Oscillation probabilities in matter 

The signatures of sterile neutrinos in 3 + 1 model with Am^ ~ 1 eV 2 on high energy 
atmospheric neutrino fluxes measured by IceCube/DeepCore have been studied in [15-21]. In 
these works the effect of sterile neutrinos on zenith distribution of muon-track events induced 
by atmospheric neutrinos and its measurement by IceCube/DeepCore were analyzed. The 
zenith distribution of muon-track events in IceCube is sensitive to #24 and stringent upper 
limits on #24 have been obtained in [21] from the analysis of muon-track events collected with 
the partially deployed detector consisting of 40 out of the final 86 strings of photomultipliers. 
In this paper, we study the 3 + 1 model exploiting cascade events induced by atmospheric 
neutrinos in DeepCore. The cascade events originate from: i) neutral current interaction 
of all active neutrino flavors (v e ,v^,v T ) and (P e ,P^,P T ); ii) charged current interaction of 
v e and v e ; iii) charged current interaction of v T and v T . The atmospheric flux consist of 
v e and Vn (also v e and Vn) neutrinos, although the electron neutrino flux is smaller than 
the muon neutrino flux by over one order of magnitude at TeV energy. While muon-track 
measurements depend on Piy^ — > v^) and P(y e — > u^), the rate of cascade events probes the 
oscillation probabilities: P{y e — > Va) and P{f^ — > v a ), where a = e,fi,T. However, it should 
be emphasized that, because the flux of atmospheric v e and v e is small, the contribution of 
P(y e — > Va) to the events, both muon-track and cascades, induced by atmospheric neutrinos 
is small. 

In the following we show the oscillograms of probabilities for various sets of values for 
the additional mixing parameters of 3 + 1 model. The probabilities are calculated by the 
numerical integration of eq. (2.1), with the standard mixing parameters: sin 2 #12 = 0.3, 
sin 2 6»i3 = 0.02, sin 2 fl 23 = 0.5, Am^ = 2.4 x 10~ 3 eV 2 and t±m\ x = 7.5 x 10~ 5 eV 2 [41]. 
In order to avoid conflict with cosmological constraints on the sum of neutrino masses, we 
assume a 3 + 1 model with Am^ > 0. The electron and neutron number density profiles of 
the Earth have been taken from the PREM model [42]. In the following we define several 
possibilities according to the vanishing or non- vanishing values of 9a, and for each case we 
discuss the oscillation probability pattern of atmospheric neutrinos. 

Case I: #14 7^ 0, #24 = and #34 = 0. In this case the ^4 (P4) mass eigenstate contributes to 
the u e (£> e ) flavor eigenstate only. The matter effects from the propagation of neutrino through 
the Earth enhance v e — > v s oscillation. Thus, we expect enhancement of the conversion of v e 
atmospheric flux to v s at energies E v ~ 4 - 5 TeV (Am^/l eV 2 ). Due to the change m sign 
of matter potential for i? e , enhancement of active-sterile oscillation takes place just for v e . In 
Figure 1 we show the oscillogram for electron neutrino survival probability as a function of 
cos # 2 and E v in the range 10 2 — 10 GeV. As can be seen, for nonzero values of #14 a dip 
develops in the P{y e — > v e ); while in standard 3z/ framework P{y e — > v e ) = 1 in the energy 
range we showed. 

Case II: #14 = 0, #24 7^ and #34 = 0. In this case the nonzero contribution of v\ (P4) is 
to {pp). Due to sign of the effective potential in the muon-sterile (anti-)neutrino system, 
the enhancement of oscillation takes place just for atmospheric flux. The enhancement 
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Figure 1: Oscillograms of survival probability P{y e — > v e ) for Am^ = leV 2 , #24 = #34 = 
and different values of sin 2 2#i4 indicated in each sub-caption. 

leads to a dip in the survival probability and a peak in the P(pn — > z/ s ). It should be 
noticed that the previous analyses of 3 + 1 model with IceCube/DeepCore using muon-track 
events [17-21], cover this case and the limits obtained in these papers constrain #24 (or i?^). 
The oscillograms for this similar to those for Case I as has been shown in [21]. 

Case III: #14 = 0, #24 = and #34 7^ 0. In this case the (z/4) contributes to v T {v T ) 
and we therefore expect enhancement of active-sterile oscillation for a v T beam. However, 
the anticipated atmospheric U T flux produced in decay of charmed particles is quite small in 
the energy range E v < 10 TeV and has not been observed. Thus, by setting #14 = 6*24 = 0, it 
is not possible to probe #34 by atmospheric neutrino data. However, active-sterile oscillation 
evidence from short baseline experiments force #14 7^ and #24 7^ 0; which we discuss next. 

Case IV: #14 7^ 0, #24 7^ and #34 = 0. In this case the 1/4 (2/4) contributes to both 
v e and Va (p e and v^) and effectively the oscillation pattern is a combination of Case I 
and Case II; i. e., the enhancement of active-sterile oscillation takes place for both v e and 
atmospheric fluxes. In this case the deficit of atmospheric flux is more significant and 
sensitivity of IceCube/DeepCore to active-sterile mixing parameters is enhanced. 

Case V: #14 7^ 0, #24 = and #34 7^ 0. In this case the enhancement of active-sterile 
oscillation takes place for v e and v T fluxes. However, as we discussed in Case III, the 
atmospheric v T flux is negligible in this energy range and sensitivity of IceCube/DeepCore 
in this case is similar to Case I. 

Case VI: #14 = 0, #24 7^ and #34 7^ 0. In this case the contribution of ^4 (z/4) to both 
Vn and v T and v T ) is nonzero. Thus, in this case we expect resonant —> v s and 
v T — > v s conversions, although the latter is absent due to the negligible atmospheric flux of 
v T . However, an interesting phenomenon is that, due to the nonzero value of 634 in this case, 
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Cos Q, 

(a) P{v^^v T ) for sin 2 20 24 = sin 2 26> 34 = 0.1 



Cos 6, 

(b) P{u^ -> iv) for sin 2 26» 24 = 0.1 and sin 2 26> 3 4 = 0.3 




Figure 2: Oscillogram of oscillation probability P{v^ — > is T ) for Am^ = leV 2 , 9±4 = and 
different values of sin 2 2#24 and sin 2 2^34 indicated in each sub-caption. 

do not completely convert to v s \ but partially converts to v T . Thus, we effectively observe 
9^ — > v T conversion, indirectly induced by v s \ this phenomenon has been discussed in [16]. 
To illustrate this phenomenon, in Figure 2 we show the oscillogram of P{pa v T ) for various 
values of 624 and #34. As can be seen, the nonzero value of #34 leads to Un — > v T conversion; 
while in 3z^ framework, in the energy range we have shown, we have P{pn v T ) = 0. 
Through this effect, the energy and zenith distributions of cascades in IceCube/DeepCore 
are sensitive to #34. We emphasize that the sensitivity to #34 is through — > v T conversion 
introduced in this case. Thus, to constrain #34, the necessary condition is #24 7^ 0, which is 
hinted by MiniBooNE and LSND anomalies. 
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Case VII: #14 7^ 0, #24 7^ and #34 7^ 0. In this case all the active-sterile mixing angles 
are nonzero and V4 (^4) contributes to all the active (anti-)neutrino flavor states. Thus, 
by analyzing zenith and energy distributions of atmospheric induced cascade events it is 
possible to constrain all the active-sterile mixing angles #14, #24 and #34; respectively through 
enhanced v e — > z/ s , — > v s and — > v T conversions. 

For the analysis of this paper we numerically calculated all oscillation probabilities 
P(y a {p a ) — > vp{vp)) as a function of cos9 z and E u , scanning the whole parameter space of 
(Am^, sin 2 2^i4, sin 2 2^24, sin 2 2^34), for more than 26,000 sets of mixing parameter values. 
In the next section we calculate sensitivity of DeepCore to 3 + 1 model by performing a 
X 2 -analysis of zenith and energy distributions of atmospheric induced cascade events. 

3 Sensitivity of DeepCore to active-sterile mixing angles 6^4 

With the oscillation probabilities in 3 + 1 model, discussed in section 2.2, we can calcu- 
late number of cascade events in DeepCore induced by the atmospheric flux of neutrinos. 
DeepCore is the inner region of IceCube which is more densely instrumented with photo- 
multipliers of higher quantum efficiency. Higher efficiency of photomultipliers, less distance 
between them, clearer ice in the deep regions of detector, and using the remainder of IceCube 
detector as a veto for atmospheric muon background, leads to a lower energy threshold for 
the DeepCore part of IceCube. Detection of cascade events have been reported by IceCube 
collaboration [43, 44]. In early DeepCore data [44] cascades have been detected with energy 
as low as ~ 30 GeV. In this section we calculate sensitivity of DeepCore to the mixing angles 
9i4 (i = 1, 2, 3), using a x 2 -analysis. In section 3.1, after discussing the rate of cascade events 
in DeepCore, we define the \ 2 function of our analysis. In section 3.2 we show sensitivity to 
9\4 and #24 mixing angles. Finally, in section 3.3, we show sensitivity of DeepCore to #34, 
which is the main result of this paper. 

3.1 Number of cascades and \ 2 function 

As we discussed in section 2.2, cascade events originate from the following interactions: (i) NC 
interaction of all active flavor neutrinos; (ii) CC interaction of v e and v e \ (ui) CC interaction 
of v T and v T . The number of cascade events from (i) is 

atNC _ A/-NO e atm , aj-NC,^ atm 
iv cas — iv cas - /v cas , 

where 

N^ M ^ } atm = TAn Picc N A I ^ NC (^)^^ m) (^,cos^) x (3.1) 

a=e,(i,T 

P(y e {vn) -> u a )V^°{E v , cos 6 z )dE v d cos 9 z + (u -> v) . 

In this equation T is the live-time of data-taking, AQ = 2ir is the azimuthal acceptance 
of DeepCore, p- lce is the ice density, Na is the Avogadro's number and a NC is the neutral 
current cross section of neutrinos. For the flux of atmospheric electron (muon) neutrinos, 
3?**^, ) (E u , cos 9 Z ), we use Honda flux [45] . P represents oscillation probabilities calculated in 

section 2.2. V^p is the effective volume of DeepCore for cascade detection. Since DeepCore 
detector resides at the inner part of IceCube detector, to a good approximation the effective 
volume is independent of zenith angle of incoming neutrinos and V^ C (E U , cos 9 Z ) = V^p{E v ). 
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Figure 3: The effective volumes used in this paper. V°q refers to the "online filter" effective 
volume of DeepCore from [46] and V^ B refers to the effective volume from [44] . 



For the value of effective volume we consider two extreme cases V^ es and V°g , denoting 
respectively a pessimistic and optimistic estimation of effective volume. For V°g we use the 
"online filter" effective volume from [46] and for V^g S we use effective volume of [44]. The 
latter corresponds to an analysis of DeepCore data using IceCube analysis tools that have not 
been optimized for the analysis of low energy events. Figure 3 shows the effective volumes 
used in this paper and it should be noticed that the realistic effective volume of DeepCore, 
after developing appropriate quality cuts, will lie between these two cases. 

The number of cascade events from (ii) and (iii) are Ncas' e and N cas ' T , respectively, 
given by 



Ng^ = TAn Picc N A £ J a cc (E u )^(E u ,cose z 



a=e,fj, 



P(u a -»• u e (u T ))V e ^(E u ,cos0 z )dE u dcos0 z + {y^v). (3.2) 

Total number of cascade events at DeepCore, iV cas , is the sum of numbers from (i), (ii) and 
(iii); i. e., iV cas = + Nc£' e + Nc£' T ■ In order to calculate sensitivity of DeepCore to 
the parameter space of 3 + 1 model, we define the following x 2 function: 



X 2 ({Am^,^ 4 } ;a,P) 



(3.3) 



E 



[N&({Aml 1} 0i4} = 0) - a (1 + 0(0.5 + cos0 z )) ^({Am^fla}) 



N l c g({Aml 1 ,9 iA } = 0) 



+ 



a 



+ 



B 2 



a 



where {Am^,^} = (Am^, #14, 024, #34) denotes the active-sterile mixing parameters, a 
and (3 are the parameters which take into account respectively normalization and zenith 
dependent uncertainties of atmospheric neutrino flux, with a a = 0.24 and up = 0.04. The 
summation indices i and j run over neutrino energy and zenith bins, respectively; such that 
Ncis shows the number of cascade events with initial neutrino energy in the i-th bin of energy 
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and cos 9 Z in the j'-th bin of zenith distribution. DeepCore detector acts like a calorimeter 
for cascade events with great precision in the measurement of released energy in cascades. 
In the analysis of IC-22 cascades, IceCube collaboration reported A(log 10 (-Ev/GeV)) = 0.18 
for the resolution of energy reconstruction [43]. In the analysis of this paper, as a realis- 
tic energy resolution for cascade events at DeepCore, we assume A(log 10 (i?j,/GeV)) = 0.1 
(see also [47, 48]). Thus, totally we have 20 bins of energy from 100 GeV to 10 TeV, with 
the width log 10 (-E^/GeV) = 0.1. In spite of the good resolution in energy reconstruction, 
direction reconstruction of cascades in IceCube/DeepCore is poor. However, by performing 
improved algorithms for the direction reconstruction, it is possible to reach direction reso- 
lution as low as 25° [47, 48]. In this paper we calculate sensitivity of DeepCore assuming 
different values for direction resolution: assuming 45° and 30° for direction resolution, we con- 
struct "two bins" ([-1,-0.7], [-0.7,0]) and "three bins" ([-1, -0.9], [-0.9, -0.5], [-0.5, 0]) 
of cos#z, respectively. Also, to find out the reward of achieving better resolution in direction 
reconstruction, we calculate sensitivity of DeepCore to 6i± assuming 10 bins of cos 9 Z (with 
width 0.1). However, we emphasize that the sensitivity with 10 bins is quite optimistic and 
achieving resolution 0.1 in cos9 z is quite challenging. 

3.2 Constraining #14 and #24 

As we discussed in Case I, Case II and Case IV in section 2.2, nonzero values of #14 and 
#24 lead to distortions in v e — > v e and —> u„ oscillation probabilities, respectively, which 
makes it possible to constrain these parameters through the detection of cascade events in 
DeepCore. In the following we show sensitivity of DeepCore to these mixing parameters. 

Sensitivity to #14: As we discussed in section 2.2, sensitivity to #14 originates from 
enhancement of v e — > u s oscillation for nonzero values of #14 (see Figure 1). However, 
since the flux of atmospheric v e is small in the high energy range that we are considering 
(®t +p /^Se+Pe ~ 30 for E v ^ 100 GeV), the low statistics leads to a poor sensitivity to 
#14 = i? ee . Figure 4 shows sensitivity of DeepCore in (sin 2 2$ ee , Am^) plane, obtained after 
marginalizing x 2 function in eq. (3.3) with respect to #24 and #34. The black, green and brown 
solid lines correspond to 90% C.L. sensitivity assuming 10, 3 and 2 bins of cos6 z , respectively. 
For all the three solid curves we used V°g (the red dashed curve in Figure 3) and six years 
of data-taking. Blue dashed curve shows the 90% C.L. allowed region in (sin 2 2$ ee , Am| x ) 
from analysis of reactor, Gallium, v e C scattering and solar data, taken from [23]. Red dot- 
ted curve of Figure 4 shows the 90% C.L. sensitivity of KATRIN experiment (measuring the 
spectrum of electrons from tritium beta decay) after 3 years of data-taking, from [30]. As can 
be seen, even with the optimistic assumption for effective volume of DeepCore and very low 
uncertainty in direction reconstruction of cascades, sensitivity of DeepCore is not enough to 
cover the favored region by short baseline experiments. However, with the realistic assump- 
tion of two bins for cos 6 Z (brown solid curve) it is possible to exclude parameter space near 
Am|j ~ 0.1 — 0.3 eV 2 better than KATRIN. With the pessimistic assumption for effective 
volume of DeepCore (blue solid curve in Figure 3), we do not have sensitivity to sin 2 2i? ee . 

Sensitivity to #24 : Sensitivity of DeepCore to #24 originates from enhancement of 9^ — > v s 
oscillation for #24 7^ 0, which leads to a decrease in the number and distortion in energy 
and zenith distributions of cascade events. In the calculation of sensitivity to #24 we assume 
#14 = 0, which implies: #24 = fi^i an d marginalize \ 2 function in eq. (3.3) with respect 
to #34. Figure 5 shows the sensitivity in (sin 2 2?? w , Am^) plane, where solid and dashed 
lines correspond respectively to V^ s and V°g for effective volume; and blue, red and green 
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Figure 4: Sensitivity of DeepCore to # ee in the plane (sin 2 2i? ee , Am^). The solid curves 
(black, green and brown, respectively for 10, 3 and 2 bins of cos #2) show sensitivity after 6 
years of data-taking with effective volume corresponding to red dashed curve in Figure 3. 
Blue dashed curve shows the allowed region from global analysis of reactor, Gallium, v e C 
scattering and solar data, taken from [23]. The red dotted curve shows sensitivity of KATRIN 
experiments after three years of data-taking, from [30]. All the curves are at 90% C.L.. 



colors correspond to 10, 3 and 2 bins of cos# z , respectively. Black dotted curve in Figure 5 
shows the strongest current upper limit from the analysis of //-tracks induced by high energy 
atmospheric neutrinos at IceCube-40 [21]. However, as we expect, due to the high statistics of 
//-track events, sensitivity calculated from cascade events at DeepCore, even with optimistic 
assumptions, is less than the IceCube-40 upper limit. Also, it should be noticed that the 
upper limit in [21]; i. e., black dotted curve in Figure 5, is calculated by fitting zenith 
distribution of energy integrated //-track data from [49] and definitely, analyzing the data 
with energy binning can improve the limit significantly. 

3.3 Constraining 834 

As we discussed in Case VI in section 2.2, nonzero values of both 824 and 834 lead to 
P{pu v T ) 7^ 0, which consequently distorts zenith and energy distributions of cascade 
events in DeepCore. Thus, in principle, by looking at zenith and energy distributions of 
cascade events in DeepCore, it is possible to constrain 834 when 824 7^ 0. It should be noticed 
that zenith and energy distributions of //-track events in IceCube would hint or constrain 
824 [17-21]; thus, by the combined analysis of //-track and cascade events, it is possible to 
establish first the hint or limit on the value of 824 and then constrain 834. In order to show the 
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Figure 5: Sensitivity of DeepCore to i? w in the plane (sin 2 2$^, Am^). The solid and 
dashed curves correspond to sensitivity of DeepCore with effective volume V^ s and V^, 
respectively. The blue, red and green color correspond to sensitivity after six years of data- 
taking with 10, 3 and 2 bins of cos9 z respectively. Black dotted curve shows the best current 
upper limit from atmospheric neutrino data of IC-40 [21]. All the curves are at 90% C.L.. 



effect of nonzero #34, we plot x 2 function in eq. (3.3) with respect to sin 2 2^34 in Figures 6a 
and 6b, respectively for two and three bins of cos9 z . In this figures sin 2 2#24 and Am^ are 
fixed to values showed in legends; and we set #14 = 0. Comparing curves with the same 
color from Figures 6a and 6b shows that, as we expect, for three bins of cos6 z sensitivity of 
DeepCore increases with respect to two bins. Comparison between blue and green curves in 
each plot shows that by increasing the value of sin 2 2#24, sensitivity of DeepCore to sin 2 2^34 
increases. Also, position of the red curve in each plot relative to green and blue curves shows 
that by increasing Am^ sensitivity of DeepCore decreases; which is a result of lower statistics 
in higher energies. 

Two features of the curves in Figure 6 require more discussion. First, is the behav- 
ior of curves for #34 — > 0, which as we expect, give a nonzero value for x 2 depending on 
sin 2 2#24 and Am^. The non- vanishing x 2 & t $34 = makes derivation of exclusion curve in 
(sin 2 2#34, Amy) plane ambiguous. One way of dealing with this ambiguity is to define 

Ax 2 = Xe w ( Am 4l> #24 = fixed, 6> 34 ) - Xe u ( , 024 = fixed, 6> 34 = 0) , 

where by Xq 14 we mean x 2 marginalized with respect to 9%4, and then derive the exclusion 
curve from this function. However, although Ax 2 at #34 = is well-behaved, the minimum of 
X 2 in Figure 6 for nonzero values of sin 2 2^34 leads to negative values of Ax 2 ', and again makes 
the interpretation of A% 2 ambiguous. The minimum of x 2 at a non- vanishing #34 is the second 
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Figure 6: The value of x 2 i n e Q- (3-3) as a function of sin 2 2^34. The left and right plots 
correspond respectively to two and three bins of cos #2, and in both plots V°£ used for 
effective volume. In these plots we assumed $14 = 0, and values of sin 2 2024 and Am^ are 
shown in legends. 
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Figure 7: Energy distribution of 
second (b) bin of cos #2. The 
JVcastAm^, sin 2 2024, sin 2 29 3A ) / N cas (Am 2 4l 



cascade events in the first (a) and 
vertical axis in each plot is ratio 
= 0, sin 2 2024 = 0, sin 2 26*34 = 0), where 



N cas is the total number of cascade events and values of mixing parameters are shown in 
legends. 



feature of curves in Figure 6, that we elaborate more on it here. As can be seen, this feature 
is obvious for low Am|j and by increasing Am^, due to low statistics, it disappears. To 
grasp the physics behind these minima, in Figure 7 we show energy distribution of cascades 
in our "two bins" analysis. The vertical axis in Figure 7 is ratio of number of cascade events 
in 3 + 1 model, with mixing parameters shown in legends, to number of cascades in 2>u 
framework. In these plots we assumed Arn^j = 0.1 eV 2 and sin 2 2024 = 0.1. In the first bin 
cos0 2 ([—0.7,0]) distortion in the energy distribution of events in very small. But, however, 
for events with cos0 2 G [—1,-0.7], the change in distribution is quite obvious. Important 
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Figure 8: Sensitivity of DeepCore in the (sin 2 26*34, sin 2 26*24) plane for Am|j = 0.1 eV 2 
(Figure 8a) and Am 2 x = 1 eV 2 (Figure 8b). All the curves are at 90% C.L.. 

feature of Figure 7b is the pattern of change in the curves for various values of sin 2 26*34 . As 
can be seen, the red curve corresponding to (sin 2 26*24 = 0.1, sin 2 26*34 = 0.02) is closer to a 
straight line than the black curve for (sin 2 2024 = 0.1, sin 2 26*34 = 0); which leads to a lower 
X 2 value for red curve with respect to black curve. The reason for this behavior is that for 
nonzero #34 some part of initial atmospheric flux converts to v T (see Figure 2), instead 
of converting to v s in the case #34 = 0, which leads to an increase in number of cascades. 
Thus, for an Am^, there is a set of (6*24,6*34) values that energy distribution of cascade 
events mimics the distribution in 3v framework which, consequently, leads to the minima 
in x 2 curves in Figure 6. By increasing the value of sin 2 26*34 in Figure 7b, and therefore 
converting almost all to v T , we can see the interesting excess in cascade events instead 
of deficit (see the brown curve in Figure 7b for sin 2 26*34 = 0.3). The excess stems from 
higher detection rate of v T (detectable by both CC and NC interactions) than which can 
be detected as cascade event just by NC interaction. We would like to emphasize that this 
excess in the cascade events is a unique signature for #34 / 0, which can be easily recognized 
in the experiment. 

The correlation between two mixing angles #24 and #34 can be seen also from Figure 8, 
which shows sensitivity of DeepCore in the (sin 2 26*34, sin 2 26*24) plane for Am^ = 0.1 eV 2 
(Figure 8a) and Arn^j = 1 eV 2 (Figure 8b), at 90% C.L. . The bump-shape behavior of 
exclusion curves for Am^ =0.1 eV 2 is a result of the correlation we mentioned. Also, from 
the curves in Figure 8 we see that sensitivity of DeepCore to #34 depends on the value of 6*24, 
as we already discussed. 

Regarding to the correlation between #24 and #24, and the non-trivial behavior of x 2 i n 
eq. (3.3), which makes derivation of sensitivity ambiguous, here we define a new chi-squared 
function to single out sensitivity to #34. In the definition of this function, x 2 , we assume a 
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Figure 9: The sensitivity of DeepCore to #34 in the plane (sin 2 2^34, Am^), obtained from x 2 
in eq. (3.4). The solid and dashed curves correspond to sensitivity of DeepCore with effective 
volume V^ es and V"^ , respectively. The blue and green colors correspond to sensitivity after 
six years of data-taking with 2 and 3 bins of cos# z , respectively. The black dotted vertical 
line shows the current upper limit from MINOS experiment [31, 32]. In the left plot we 
assumed sin 2 2^24 = 0.05 and in the right plot sin 2 2^24 = 0.1. All the curves are at 90% 
C.L.. 



pre-determined value for #24 from other experiments, including the IceCube //-track events 
which is sensitive to this parameter. Also, we marginalize with respect to #14. The x 2 
function is defined by 



(1-a) 2 B 2 

X 2 {^ml 1 ,9 2A = fixed, 34 ; a, /3) = ^ + ^+ (3.4) 

cri cri 



'■j 



tei(Am 2 1; 24 = fixed, d u = 0) - a (1 + 0(0.5 + cos 9 Z )) C(Am^,fe = fixed, 6^ 2 



JVc^Am^, 6 24 = fixed, 9 34 = 0) 



where the parameters a and /3, and their corresponding uncertainties, are the same as 
eq. (3.3). After marginalizing x 2 with respect to a and /3, sensitivity in the (sin 2 26*34, Am 2 x ) 
plane can be derived. Figure 9 shows the result of our analysis, for sin 2 26*24 = 0.05 (Fig- 
ure 9a) and sin 2 26*24 = 0.1 (Figure 9b), at 90% C.L.. Dotted vertical black line shows the 
current upper limit sin 2 26*34 < 0.59 from MINOS experiment [31, 32]; which we discussed 
in section 2.1. In Figure 9 solid and dashed curves correspond to sensitivity of DeepCore 
with effective volume V^ s and V"^; blue and green colors denote sensitivity for 2 and 3 
bins of cos6* z , respectively. Comparing left and right plots in Figure 9 shows that by in- 
creasing sin 2 2024, sensitivity of DeepCore to #34 increases, which is a result of more efficient 



- 15 - 



i/„ — > v T conversion. As can be seen, even with pessimistic assumption for effective volume 
and two bins of cos #5; (the blue solid curves), which is certainly realistic, it is possible to 
probe sin 2 2^34 values below the current upper limit. With pessimistic effective volume and 
two bins of cos^, sensitivity of DeepCore is down to sin 2 2^34 ~ 0.1, which is a factor of six 
smaller than the current limit. 

4 Conclusion 

Several anomalies in neutrino oscillation experiments including reactor, Gallium, LSND and 
MiniBooNE anomalies, may hint at the presence of one (or more) almost sterile neutrino 
states in the mass range ~ 1 eV in addition to the established three active neutrino states. 
Simplest model accommodating a single sterile state is the so-called 3 + 1 model that intro- 
duces four new mixing parameters: ^4 and Am^ [i = 1, 2, 3). Among the mixing angles, fits 
to reactor neutrino, LSND and MiniBooNE data indicate non-vanishing values for #14 and 
024- For #34 the only available information comes from comparing the rate of NC interaction 
between near and far detectors in MINOS experiment which constrain this mixing angle to 
sin 2 26I34 < 0.59 at 90% C. L.. 

Active-sterile neutrino oscillations are enhanced by matter effects in propagation of the 
atmospheric neutrino flux through the Earth; for Am^ ~ 1 eV 2 enhancement is maximal 
for neutrino energies of E v ~ TeV. This energy is well within the sensitivity range of large 
neutrino telescopes such as the IceCube detector at South Pole. The instrument detect 
neutrinos through //-tracks initiated by muon neutrinos and cascade events originating from 
electromagnetic and hadronic showers produced by neutrinos of all flavors. 

Specifically, nonzero values of #14, #24 and #34 lead to enhancement of v e — > v s , —> v s 
and v T — > u s oscillations, respectively. As a result of absence of a significant number of v T 
and small contribution of v e to the atmospheric neutrino flux, constraining #14 and #34 is 
challenging. In contrast constraining #24 is feasible by measurement of the high statistics 
/i-track events. Using this method the strongest upper limit on #24 for masses below 1 eV 
has been obtained by analyzing the IceCube-40 //-track data [21]. 

In this paper we proposed a new method for the determination of mixing angle #34 
which quantifies v T — v s mixing. The method is based on the fact that when both #24 and 
#34 are non-vanishing, the sterile state indirectly induces 9^ —> v T conversion. Since the rates 
of and P r -induced cascades in IceCube are different (the former generate cascades by NC 
interaction and the latter by both NC and CC interactions), — > v T conversion distorts 
energy and zenith distributions of cascade events. We have shown that IceCube is sensitive 
to this distortion and by a few years of data-taking it is possible to probe #34 values well 
below the current upper limit. 

In our analysis we included DeepCore part of IceCube detector which benefits from a 
lower energy threshold for detection of cascades that can be reconstructed with improved 
resolution in energy and direction. For the effective volume of DeepCore that is still being 
improved, we have considered two extreme cases such that the final effective volume will be 
between the pessimistic and optimistic estimates. We have shown that even with for the 
pessimistic estimate of effective volume, DeepCore will improve present constraints on 634 
angle by a factor of ~ 6. 

We have also shown that nonzero values of #24 and $34 result into a unique signature 
in energy distribution of cascade events in DeepCore. While the presence of sterile neutrinos 
typically lead to a deficit in energy distribution of events through the — > u s conversion, 
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nonzero value of #34 enhances — > v T which leads to an increase in the number of cascade 
events with energy ~ 3 — 5 TeV (Am^/eV 2 ). This increase in number of cascade events is 
a direct manifestation of #34 / 0, especially when combined with a corresponding deficit in 
number of /U-tracks due to #24 / 0. 
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